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Abstract. The asymptotic behavior of a stochastic network represented by 
a birth and death processes of particles on a compact state space is analyzed. 
Births: Particles are created at rate A+ and their location is independent of 
the current configuration. Deaths are due to negative particles arriving at 
rate A_. The death of a particle occurs when a negative particle arrives in its 
neighborhood and kills it. Several killing schemes are considered. The arriving 
locations of positive and negative particles are assumed to have the same dis- 
tribution. By using a combination of monotonicity properties and invariance 
relations it is shown that the configurations of particles converge in distribu- 
tion for several models. The problems of uniqueness of invariant measures and 
of the existence of accumulation points for the limiting configurations are also 
investigated. It is shown for several natural models that if < A_ then 
the asymptotic configuration has a finite number of points with probability 1 . 
Examples with A_|_ < A_ and an infinite number of particles in the limit are 
also presented. 
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1. Introduction 

In this paper one studies the asymptotic behavior of configurations of points 
in a compact state space H. Two types of particles, "-f " and "— " , arrive on H 
according to some arrival process. 

— A particle stays at its arriving site x, adding therefore a new point at 
the location x to the current configuration. 

— A "— " particle arriving at x kills a point of the configuration if there is one 
in a specified neighborhood of x. In any case a "— " particle disappears. 

These natural models of birth and death processes of particles occur in several 
domains. 



Date: 02/08/2010. 

Key words and phrases. Stochastic Networks. Queueing Systems. Birth and Death Processes. 
Stationary Recursive Equations. Random Point Processes. Backward Coupling. Stationary Point 
Processes. 



2 



PH. ROBERT 



(1) Queueing Systems. 

When there are only a finite number of possible locations a;i, . . . , Xp for 
the particles, this model is equivalent to p single server queues where + are 
jobs arriving in one of the queues of the system and the arrival rate of — 's 
at location x^, 1 < fc < p is simply the service rate of the kth queue. 

(2) Stochastic networks. 

In the context of a wireless network, the "+" particles represent the requests 
for transmission at some location. A " particle is the capacity of service 
available in the neighborhood of a point at some moment. The assumption 
that the closest + of a — is transmitted is an approximation of the fact 
that, for energy dissipation reasons, this + transmits with the highest rate. 
See Foss [7] for related mathematical models and Serfozo [24j . 

(3) Biological Networks. 

Growth models of protein networks can be represented by points in a three- 
dimensional cube, the birth of points corresponding to the local extension 
of filaments. See Beil et al. [I] and Liick et al. [14 . 

(4) Matching problems in theoretical computer science. 

For multi-dimensional on-line bin packing problems. In this setting, a -I- 
is an item A which is alone in its bin, once an item whose size matches 
"well" with that of A, both of them are stored in the bin and A is therefore 
removed. See CofFman et al. [3] , Robert [20] and Karp et al. [9] for example. 

(5) Statistics. 

Ferrari et al. [6] presents a simulation method of the invariant distribution 
of reversible processes on configurations of points in R'' with constant birth 
rate and whose death rate of a particle is proportional to its multiplicity. 

In the following iJ is a compact metric space and [H) denotes the space of non- 
negative Radon measures on H carried by points. See Rudin |22j and Dawson [S] 
for the main definitions and results on 7W(7J). When the state Mq of the initial 
configuration has n points zi, Z2, 2:„, it will be described as an element of 
A4{H), a point process on H, i.e. Mq ^ Sz^ + + ■ ■ ■ + 5z„ , where 5x is the Dirac 
mass at X H. 

Starting from Mq, if the next particle arrives at the location Xi and its class is 
given by /i G {+, — }, then the next state of the configuration is Mi defined by 

(1) Ml = Mq + l{i,=+}Sxi - l{i, = -}St,(XuMo), 

where ti{Xi, Mq) is the (possible) location of the point of Mq which is removed. It 
may happen that no point is removed, the Dirac mass at ti{Xi, Mq) is understood 
as the measure on H in this case. Several definitions for ti(Xi, Mq) are now pre- 
sented depending on the model considered. The function {x,y) i— > d{x,y) denotes 
the distance of the metric space H. 

The Cases of Local Interaction. In this setting a "— " particle arriving at x G H 
can only kill a point located in a ball B{x, 1) of radius 1 around x. If B{x, 1) does 
not contain a point of the configuration, the "— " disappears. 

(1) Local Greedy Policy (LG). The point ti{x,M) is the point of M which is 
the closest to x and at distance less than 1: i.e. a y E H such that 



y) = ini{d{x, z) : z £ H, M{{z}) ^ and d{x, z) < 1}. 
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By convention, if there is not such a point the Dirac measure dt-^(^x,M) is 
defined as the measure. In the case there are several points achieving 
the above infimum, ti{x, M) is chosen at random among the corresponding 
locations. 

(2) Local Random Policy (LR). The point ii(a;, M) is chosen at random in the 
subset [z H : M{{z}) ^ and d{x,z) < 1}. 

(3) Local One-Sided Policy (LO). It is assumed that _ff is a subset of for 
some d>\. The point ti^x^M) \s y ^ H such that 

d{x, y) = inf {(i(a;, z) : z & H,M {{z}) ^ 0, d{x, z) < 1 and z > x}, 

where the inequality z > a; is understood coordinate by coordinate. These 
policies occur in the context of matching problems. See Karp et a/. [5]. 

Global Interaction. In this case there is no constraint of locality to kill a point. 

(1) Global Greedy Policy (GG). The point ti{x,M) is y e H such that 

d{x, y) mi{d{x, z) : z e H, M{{z}) ^ 0}. 

(2) Global One-Sided Policy (GO). The point ti{x,M) is y £ i? C M'^ such 
that 

d{x, y) = mi{d{x, z) : z e H,M {{z}) ^ and z > x}, 

Related Spatial Processes. When the arrival processes of positive and negative 
particles are independent Poisson processes, the system can also be described as a 
continuous time Markov process. The associated infinitesimal generator f2 can be 
expressed as follows: For a convenient functional F on the space A4{H), 

0(F) = A+ / (F(r/ + 6x) - Fir^))ti{dx) 

JH 

+ A_ / {F{Tj-Sy)-F(7j))S(x,y,v)v{dy)fi{dx), 

JH 

where fi is the distribution of Xi. For example, for the LG policy, the death rate 
S is defined as 

H^iy^V) = '^{d{x,y)<lAd(x,r)-Sy)}, 

where, a Ah — min(a, b) and, ioT y ^ H and /j, S M.{H) 

diy,,!)"^- diy,{zeH:fi{{z})^0}). 

This is the point of view of Garcia and Kurtz [5] where Markov processes with 
general birth rates and constant death rates are introduced for the evolution of 
point processes on a non-compact state space. See Penrose [TO] for a survey. The 
main problem analyzed in this case is the construction of a Markov process with 
values in the space of point processes: due to the interaction and the non-compact 
state space, it is not possible to order the jump instants so that the existence result 
is not straightforward. Additionaly Penrose [12] presents some limit results (Law 
of large numbers and central limit theorem) but from a spatial point of view: the 
asymptotic behavior at some fixed time of some additive functional of the point 
process in a ball whose diameter goes to infinity. 

In this paper, one does not use explicitly the characterization of these processes 
by their infinitesimal generator. The state space being compact, the existence 
results are straightforward. Limit results are investigated not with respect to a 
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spatial component but with respect to long time behavior, when does the config- 
uration converges in law ? Since the state space is not of finite dimension, the 
classical tools using a Markovian approach, like Lyapunov functions, see Chapter 8 
and 9 of Robert [21 for example, seem to be more difficult to use. The dynamic 
which is investigated in this paper is specific but as it will be seen it already leads to 
some non trivial problems: in some cases, at equilibrium, the associated stochastic 
process will not live in the space of Radon measures for example. See Section [6l 

Stability Property. The arrival rates of "+" and "— " particles are denoted re- 
spectively by A+ and A_ and the particles are represented by a sequence (/„,X„) 
where, for n > 1, /„ G {-|-, — } is the type of the nth particle and X„ G iJ is its 
location. When there are more "— " particles than "-|-" particles, i.e. A+ < A_, it is 
likely that the distribution of the configuration should converge to a random point 
process having a finite number of points with probability 1. This property will be 
referred to as the stability property of the system. 

For the GG policy, this property holds: with some independence assumptions, 
the total number of points evolves as a refiected random walk on integers with 
the negative drift A+ — A_. In this case, the geometry plays a minor role in the 
dynamics. 

As noted by Anantharam and Foss, see Foss fT], the situation is quite different 
in the case of local interaction. The stability property is quite challenging to prove, 
even for the one-dimensional circle Ti (T) of length T > for example. Mathemati- 
cally, the stability property is formally defined as follows: There exists a probability 
distribution Q on the set Ai{H) of finite Radon measures on H such that 

a) Invariance: if Mq ' Q, then Mi Q. 

b) Convergence: if Mo G M.{H) and (Af„) is the sequence of consecutive 
configurations, then (M„) converges in distribution to Q. 

It is quite natural to consider a Markovian approach to investigate the stability 
property. The sequence (M„) can be seen as a Markov chain on M{H). In fact, as 
it will be seen, the space M.{H) will prove to be too small to investigate properly 
these questions, a larger space of measures has to be defined. One may try to prove 
the Harris ergodicity property of (Af„) which would give directly the properties 
a) and b). See Nummelin [18j for example. In our case, due to the dynamics of 
the process and the complexity of the space Ai{H), a Markovian approach does 
not seem to work for a general state space H. Furthermore, as it will be shown, 
symmetry properties play an important role in these questions. It does not seem 
that they can be really taken into account with a Markovian approach to tackle 
the general case. By using an interesting but specific Lyapunov function, Leskela 
and Unger [TI)^ proposed recently an alternative proof of the stability property in 
the case of the one-dimensional torus. 

For the existence of an invariant distribution, the approach used in this paper 
consists in replacing the problem of finding a distribution Q which is invariant by 
Equation ([T]) by the problem of existence of a random variable M on Ai {H) such 
that 

(2) Moe^M+ l{i,=+}5x, - l{/,=_}(5(,(Xi,M„), 

holds almost surely, where is a shift operator on a convenient probability space. 
This method goes back to Loynes [13] to study the stability of a refiected random 
walk associated to a stationary sequence. 
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Loynes's method (1962), which can be seen as a backward couphng, has been 
used to study stochastic recursions in R'^, associated to several queueing systems. 
See Neveu [T^ (1983) and the references therein. Robert (1987) used it to study 
a bin-packing algorithm related to the GO policy defined above. Propp and Wilson 
(1996) used this method (under the name "coupling from the past") in the context 
of the Ising model. See Levin et al. [11] for a discussion on backward couplings. As 
always with backward couplings, a monotonicity property is the main ingredient 
to prove the existence of a random measure M solution of Equation © . It turns 
out that the existence result holds in quite general framework. See Borovkov and 
Foss 2\ for a general presentation of the analysis of stochastic recursions. 

In a second step, invariance relations and symmetry properties provide key ar- 
guments to prove the main results of the paper, i.e. that such a M is unique and 
that the convergence property (b) holds. These invariance relations have an impor- 
tant impact as it will be seen since the solution of Equation ^ have a finite mass 
with probability 1 when they hold. On the other hand, one exhibits examples for 
which these symmetry relations fail and the solution M has an infinite mass with 
probability 1. 

Outline of the Paper. The paper is mainly devoted to policies with local in- 
teractions when the proportion p^ of = A+/(A+ -I- A_) is less than 1/2. 
Section [2] introduces the main definitions and notations required, in particular, to 
deal with point processes which may have an infinite number of points. Theorem [1] 
of Section [3] shows that under general conditions that there always exists a random 
point process with possible accumulation points such that the invariance relation a) 
holds for all policies listed above. In this general setting, a stronger result is shown 
for the local random policy: the invariant point process has a finite number of 
points with probability 1, i.e. the stability property holds. Section |4] considers an 
homogeneous case when _ff is a compact metric group, like the c?-dimensional torus 
or the d-dimensional sphere. It is proved that there exists a unique random point 
process M satisfying Relation ([2|) which has a finite mass with probability 1 and 
such that convergence property b) holds. This proves in particular the stability 
property for homogeneous state spaces for all policies with local interaction. Sec- 
tion [5] studies a simple non- homogeneous setting H — [0,T] for the LG policy. It 
is proved that the stability property also holds in this case. Section [6] considers 
one-sided policies on H — [0,Ti] x • • • x [0,Tc(], it is shown that Properties a) and 
b) also hold in the case but with a limiting point process having an infinite number 
of points with probability 1. 

Acknowledgments. The author wishes to thank Serguei Foss for a discussion on 
this subject and for the reference Foss 7,. 

2. Evolution Equations of Point Processes 

The main notations and definitions concerning point processes are first intro- 
duced. See Rudin [22] for the general definitions and results on Radon measures, 
Dawson [5] for an introduction to random point processes and Neveu [16] on sta- 
tionary point processes. 

2.1. Point Processes. It is assumed throughout the paper that is a compact 
metric space (think of a bounded closed subset of R'' for example). A point process 
M on is a non-negative Borel measure on H carried by points, i.e., such that. 
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for any Borel subset A of H one has M (A) eNU {+00}. Define M*{H) as the set 
of all pomt processes. If M G A4*{H), S{M) denotes the set of its accumulation 
points, 

S{M) {y e H -.We > 0, M{B{y, e)) = +00}. 

Note that S{M) is in particular a closed set. The space A4{H) is the subset of 
A4*{H) of Radon non-negative measures with finite mass, i.e., the set of elements 
M € AA*{H) such that M{H) < +00. As it will be seen, for some policies the 
state space M{H) is not always appropriate to study the asymptotic behavior of 
configurations of points in H. 

If / : i? M is some Borel function, 

{f,M)=- f f{x)M{dx), 

J H 

in particular (1^,M) — M{A) if A is a Borel subset of A. A sequence of point 
processes (M„) in M.{H) will be said to converge to M e M*{H) if the sequence 
{{f,Mn) converges in distribution to {f,M), for any continuous function / with 
compact support in _ff — S{M). 

The ordering of point processes is defined as follows. 

Definition 1. If M and P G A4*{H), one denotes by M <^ P if the relation 
M{A) < P{A) holds for any Borel subset A of H . 

If M ^ P, the elements in the support of M are in the support of P. 

Extension of the definition of the functional ti(-,-) on H x A4*{'H.). 
For X & H, the variable ti{x,M) has been defined in Section [T] for M 6 M{H), i.e. 
when the point process has only a finite number of points. Since the space M{H) 
is not closed for the topology of weak convergence, one has to define it when there 
are accumulation points. Furthermore it will allow 

(1) To have a limiting evolution equation for the possible limiting points of the 
sequence (Af„) of the successive states of the configuration. 

(2) To properly define the problem of uniqueness of the invariant distribution 
for Equation ([T]). 

The definition of ti{-,M) is extended to an arbitrary element M of Ai*{H). For 
that, one denotes by 9 a cemetery state for which Sd is the null measure. The 
variable ti{x, M) is defined as d when M{B{x, 1)) = (no point to kill) and in any 
of the following situations. 

— LG policy. 

(1) there exists an accumulation point aG5(M) such that d{x,a)<l, 
M({a})=0 and M{B{x,e))^0 for all e < d{x,a). 

(2) there exists < r < I such that M{B{x,e)) = for all e < r and the 
set {y & H : d{x, y) = r, M{{y}) ^ 0} is infinite. 

— LR policy, when M{B{x, I)) = +00; 

— LO policy. Similar to LG policy by replacing balls B{x,e), x ^ H, e > 
by B{x,e) n {y : y > x}. 

This definition gives the following proposition. 

Proposition 1. For the LG, LO, LR policies, if{Mn) is a non- decreasing sequence, 
for the order of point processes of M.{H), such that M„+i(iJ) < Mn{H) + 1, if 
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M e Ai*{H) is its limit, then the convergence in distribution 

lim <5( (a; M„) = St M) 

holds in M{H - S{M)). 

Proof. One considers only the LG policy, the arguments are similar for the other 
policies. 

If < M{B{x,e)) < +00 for some £ > 0, then the sequence (^1(2;, Af„)) is 
constant after some finite rank so that the convergence trivially holds. Different 
cases have to be considered. 

— If there exists Eq > such that M{B{x, Eq)) — and AI{B{x,e)) = +00 
for any e > Eq. Under this assumption, this implies that any accumula- 
tion point of the sequence (ii(x,M„)) is an accumulation point of M and 
consequently, in the space M.{H — S{M)), 

— Similarly, if there exists eo > such that M{B{x, e)) = for any e < Eq and 
M{B{x,£o)) = +00. This implies that after some finite rank, the sequence 
{ti{x,Mn)) is in the set A — {y : d{x,y) = Eq}- Since the LG policy 
chooses the point at random on A, as n goes to infinity, the distribution 
of {ti{x, Mn)) will be concentrated around the accumulation points of M 
in A, so that the desired convergence will hold for the Dirac masses at the 
corresponding points. 

□ 

2.2. Probabilistic Model. It is assumed that the arrival times of + [resp. — ] is 
a stationary marked point process (s+, X+) [resp. {s~,X~)] on K and that {X:^) 
and {X~) are independent stationary sequences with the same distribution (the 
location of points at the arrival does not depend on the type). The superposition of 
the two stationary point processes (s^, +,X^) and (s^, ~,X^) yields a stationary 
point process (s„,/„,X„) where /„ £ {+, — } is the type of the nth particle. Note 
that /„ is independent of X„. Under the Palm measure P of this stationary point 
process the sequence (s„+i— s„, /„, X„) is stationary, i.e. its distribution is invariant 
with respect to the shift 6 of coordinates. See Neveu [1^ or Robert [21 . The two 
sequences (/„) and (Xn) will be assumed to be independent. One denotes by 
p+ = P(/i = +) and /i is the distribution of Xi. 

2.3. Evolution Equations. The evolution of the configuration describing the sys- 
tem is represented as a stochastic process (Nn) with values in A4{H). For n G N, 
Nn is the state of the configuration after the nth arrival. It is defined as follows, 
Nq G A4{H) and the following recurrence holds, for n > 1, 

(3) Nn = Nn-l + l{I^ = + }6x„ - !{/„ = -, JV„_i(B(X„,l))5^0}'^ii(J>s:„,A'„_i): 

with, for M e M{H) and x e H such that M{B{x,l)) / 0, ti{x,M) is the 
(possible) location of the point of M which is removed in B(x, 1) when a — particle 
arrives at x in the configuration M. See Section [T] for its definition for the LG, LR 
and LO policies. 
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2.4. Stationary Evolution Equations. For convenience, the framework of er- 
godic theory wih be used, see Cornfeld et al. [4 for an introduction. It can be 
assumed that all these random variables are defined on a probability space (O, J^, P) 
equipped with an automorphism^ i.e. an invertible transformation 6 : ^ such 
that leaves the probability P invariant, i.e. 61 o P = P. In this setting, the relation 

(s„ - s„„i,X„,/„,n G Z){9{uj)) = (s„+i - s„,X„+i,/„+i,n G Z)(w) 

holds for any cj G fJ. The map 9 is the shift for these stationary sequences. In 
particular for n G Z, Z„ = Zi o 6*" for Z G {X, /}, where 0" is the nth iterate of 
the mapping 6. One denotes by J-q the cr-field generated by the random variables 
/i o 6*", Xi o 6*", n < — 1. It is assumed throughout the paper that the dynamical 
system (il, J^, P, 0) is ergodic: any event A G J-" invariant by 0, that is 9{A) — A, 
has either probability or 1. 

Additionally, a family {Uf,F finite subset of H) of independent random vari- 
ables on finite sets is assumed to be defined to handle the case when the point to be 
removed has to be chosen at random among several points. If _F is a finite set. Up is 
a uniformly distributed random variable in F. The formal formulation is skipped. 

In this setting, a fixed point equation for random point processes is introduced, 
a solution N G A4*{H) is such that the relation 

(4) N o9 ^ N + l{i^=+}6xi - l{/i=-,jv(B(Xi,i))#o}'5ti(Xi,A') 

holds almost surely. The distribution of such an N provides an invariant distri- 
bution of the Markov chain (iV„) defined by Equation ([3]). Equation (j?]) is the 
analogue, for point processes, of the formulation used by Loynes [13| to analyze 
Lindley's Equation 

Wn = max(W„_i + Z„_i,0), n>l. 

It is reduced in this case to the problem of the existence of a finite random variable 
W satisfying the relation 

(5) Wo9 = miix{W + Zi,0), 

almost surely. See Robert [3T]. The representation in the framework of ergodic 
theory, i.e. with the shift 9, is due to Neveu [T^- This formulation goes back to the 
nice paper Ryll-Nardzewski |23J for general stationary point processes. 

Invariant Distribution of the Continuous Time Process. An invariant dis- 
tribution Q on A4*{H) of the Markov chain {Nn) defined by Equation ^ gives the 
equilibrium at the instants of arrival of particles. An invariant distribution Q on 
A4*{H) for the corresponding continuous time jump process (Nt) on AA*{H) can 
then be defined by 

/ F{M) Q{dM) = (A+ + A_)E ( si / F{M) Q{dM) ) , 
Jm'(h) \ Jm'-(h) ) 

for any non- negative Borel function F on A^*(i/). See Neveu [IB] . 

3. Existence of an Equilibrium 

The following property is essential to have the existence of an equilibrium dis- 
tribution for the evolution equations ([3]). 
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Lemma 1 (Monotonicity) . For the policies LG, LR and LO, if Pq and Qo G M{H) 
are such that Pq ^ Qo then there exists a coupling between any two sequences (Pn) 
and (Qn) satisfying the evolution equation ^ with the initial conditions Nq — Pq 
and Nq — Qq respectively, such that the relation Pn ^ Qn holds for all n > 0. 

Proof. It is enough to prove the lemma for the first step. 

If /i = + then Pi = Pq + and Qi = Qq + Sx^ so that the relation Pi Qi 
holds. 

Otherwise Ii = — , since Pq{B{Xi, 1)) < Qq{B{Xi, 1)), the only interesting case 
is when Qq{B{Xi,1)) 7^ 0. 

— Pq{B{Xi, 1)) = 0. A point of Qo not in the support of Pq is suppressed so 
that Pi ^ Po < Qi- 

— Pq{B{Xi, 1)) ^ 0. The three policies are treated separately. 

— LR policy. Let U a uniformly distributed random variable on the set of 
points of Qo within B{Xi, 1). If Pq{{U}) ^ 0, the point U is removed 
both for Pq and Qo. Otherwise, Pq{{U^) = 0, [/ is removed from Qo 
and a random point of Po within B{X\^ 1) is removed. In any case, 
the relation Pi ^ Qi holds. 

— LG Policy. It the point of Qo with minimal distance to X\ belongs also 
to Po then it is removed for both point process. Otherwise another 
point of Po is removed, hence Pi <C Qi holds. Note that if one has to 
chose at random among points at the same (minimal) distance of X\ , 
one proceeds as for the LR policy. 

— LO Policy. Same argument as for the LG policy. 

The lemma is proved. □ 

A Solution to the Stationary Evolution Equation. The asymptotic behavior 
of the sequence (Nn) defined by Equation ([3]) is analyzed in the following. 

Define the sequence (iV„) on the probability space by induction as follows, 
Nq = where, with a slight abuse of notation, stands for the null point process 
and, for n > 1, for G i7, by using the fact that is an automorphism of the 
probability space, the point process Nn{id) is defined by 

Nn{uj) = iV„_i(6l"^(a;)) + l{i^{e-^uj})=+i}^Xi{e-^uj)) 

~ l{/i(e-i("))=-i,lv„_i(B(Xi,i))(e-i(t^))#o}'^ti(Xi,lv„_i)(e-i(tj))- 
or in a more compact form, 

(6) NnOB^ Nn-\ + l{/i= + l}(5xi - l{/i=-l,lV„_i(B(Xi,l))#0}'^ti(Xi,lV„_i)- 

Lemma 2. The sequence (N n) is FQ-measurahle and {Nn ° = {Nn), where 
{Nn) is the sequence defined by the recurrence ([3]) with Nq — 0. In particular, for 
n > 1, the point processes Nn and Nn have the same distribution. 

Proof. This is done easily by induction. By using the above relation 

Nn=Nn-l°0 ^ + l{/io6l-i=+l}'^Xio0-i 

^ ■'^{/ioe-i=-i,lv„_i(s(Xi,i))oe" Vo}'^ti(Xi,lv„_i)oe-i ' 
one gets that iV„ is a functional of the random variables 

{h oe-'',Xioe-''), l<k<n, 
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and therefore J^o-measurable. By using again the above relation and replacing 
(/i o o by {In,Xn), this gives 

~ l{/„=-,]v„_ioe"-i(s(Ji:„,i))#o}'^ti(x„,]v„_ioe"-i)- 

hence the sequence (iV„ 06'") satisfies the same recursion ([3]) with the zero measure 
as initial state. It has therefore the same distribution as (iV„) with Nq = 0. The 
lemma is proved. □ 

Theorem 1 (Existence of a Unique Minimal Equilibrium). If p+ < 1/2, for the 
LG and LO policies, there exists a unique random variable N such that the relation 

(7) N oO = N + l{i^=+]6xi - '^{h=-M{B(Xi,l))^0}^ti{Xi,N), 

holds almost surely in the space M.*{H) and which is minimal for the order <C.' 
if M is a random point process satisfying Relation ([7]), then N<S^M holds almost 
surely. Such a random variable is To-measurable. 

Let S{N) be the (possibly empty) set of accumulation points of N. It is impor- 
tant to note that Relation ([7]) is valid as an identity in the set M.{H — S{N)) of 
Radon measures on H — S{N). As it will be seen, S{N) is in fact a deterministic 
set. 

Proof. As before (Nn) denotes the sequence defined by Equation ©. The proof is 
done for the LG policy. The arguments for the LO policy work much in the same 
way by replacing the open balls B{x, 1), x € H,hy B{x, 1) n {y > x}. 

Convergence of the sequence (Nn). 

Since clearly A^o ^ A^i, the above lemma shows that A^i ^ A2 and by induction 
Np <C Np+i for any p+ > 1. Consequently, there exists a non- negative random 
measure A^, such that for any Borel subset A of H, 

N{A)^ lim tNpiA) 

holds almost surely. The random variable A^ is J"o-nieasurable as an almost sure 
limit of the -Fg-ineasurable sequence (A^„). Relation ^ gives that for any n > I 

\Nn{A)oe-Nn-liA)\ < 1 

consequently, the set {N{A) = +00} is invariant by 9 and, hence, of probability 1 
or by the ergodicity property. This argument is used repeatedly in the following. 

N is a solution of Equation ([7]). 

One checks the equation when Xi ~ x (z H, this is a direct consequence of Propo- 
sition dl]). 

If M is a point process satisfying Relation (O then clearly ^ M, and therefore 
Ai o <C M o by Equations (O and By induction one gets that, for any 
n > 1, A^„ ^ M and consequently N ^ M. The variable A^ is minimal for the 
order 

A^ is in A4*{H) with probability 1. 

It remains to prove that the set S{N) of accumulation points of A^ has almost surely 
an empty interior. The ergodicity property shows that S{N) is a deterministic 
subset of H. If S{N) does not have an empty interior, there is some x € H and 
£ > such that B\x,e) c S{N). 
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Equation ^ gives the relation 

NnoeiB{x,e)) ~Nn-iiB{x,s)) 
= pF{Xi e B{x,e)) - (1 -p)P(lV„_i(S(Xi,l)) ^ QMXi,Nn-i) e B{x,e)) . 

By integrating the above relation (Note that Nn{H) is bounded by n), by us- 
ing the invariance of 9 with respect to P and the monotonicity of the sequence 
{Nn-i{B{x,e))), one gets the inequality 

P(7V„_i(B(Xi,l)) ^ QMXuNn-i) e B{x,e)) < -^P (Xi e B{x,s)) 
and hence 

P(iV„_i(B(Xi,l)) ^ 0,Xi G B(x,£),ii(Xi,iV„_i) e Bix,s)) 

< -^F{XieB{x,e)). 
1-p 

By assumption, the non-decreasing sequence of sets 

On - {NniB{Xi,l)) ^0,Xie B{x,e),hiXi,Nn) e B{x,e)} 

is converging to U„0„ — {Xi e B{x,e)}. By letting n go to infinity in the above 
inequality, this gives the relation 

P {Xi G B{x, e)) < ^+ P {Xi G B{x, £)) . 
1 -P+ 

Since V {Xi G -B(a;,e)) is non-zero, otherwise one could not have accumulation 
points in B{x,e), this yields j3+ > 1/2. Contradiction. The set S{N) has therefore 
an empty interior. The theorem is proved. □ 

The next result shows that a much stronger statement holds for the local random 
policy: the corresponding minimal variable N has almost surely a finite mass. 

Theorem 2 (Stability of Local Random Policy). Ifp+ < 1/2, for the local random 
policy, there exists a unique minimal random variable N satisfying relation ([7]) . the 
point process N has a finite mass with probability 1, F{N G A4{H)) = 1. 

Proof. One has first to check that the limit N of the sequence {Nn) is a solution 
of Equation jT]). 

— If < N(B{x,l)) < +0O, the sequence {ti{x, Nn)) is constant after some 
finite rank and so Equation ([7]) holds. 

— Otherwise, if there exists some < £o < 1 such that if e < eo then 
N{B{x,e)) = and if e > £0 then N{B{x,e)) = +00. Let 5*1 be the 
accumulation points of N in B{x,l). Because of the random choice in 
B{x, 1), the limit points of the sequence {ti{x, Nn j) are therefore all neces- 
sarily on Si C S{N). The sequence of Dirac measures ^(j(^iv„) converges 
to in the set 7W(i? - S'(iV)). 

Assume that the set S{N) of accumulation points of N is not empty. It is known 
that it is deterministic, denote by 

S*{N)^{yeH:d{y,S{N))<l}, 
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the set of points at distance less than 1 of S{N). Equation ^ gives the relation 

E[N,,+,{S*{N))]-E[N,,{S*{N))] 

= pP(Xi e S*{N)) - (1 -p)P(lV„(B(Xi,l)) ^ 0,ti(Xi,lV„) e S*{N)) . 
and therefore, by monotonicity, the inequality 

j^F [Xi e S*{N)] > P [Nn{B{X,, 1)) ^ 0,h{Xi,Nn) G 5* (TV)] 
1 — p 

> P [Nn{B{Xi, l))^0,Xie S*iN),h{Xi,Nn) e S*{N)] . 

By definition of S{N), the set {y e H : N{{y}) ^ 0,d{y,S{N)) > 1} is almost 
surely finite. If a; G S*{N), then almost surely N{B{x, 1)) = +oo, so that, because 
of the random choice among the points of Nn{B{x, 1)), 

lim ¥[N^{B{x,l)) ^ 0,hix,N,,) e S*{N)] -1. 
By using this relation in the above inequality, this gives 

^+ P [Xi e S* (N)] >P[Xie S* (N)] , 
1-P+ 

and consequently ¥{Xi e S*{N)) = 0. If a G S*{N), because of the dynamics of 
the process, there exists some e > such that F{Xi £ B{a,e)) > 0. Contradiction. 
The set S*{N) is therefore empty. The theorem is proved. □ 

Although the existence result is important in its own right, it is only a first step 
to study the stability properties of these systems. Uniqueness and convergence 
results turn out to be much more challenging in general when studying stochastic 
recursions of the type ([3]). This is the main subject of the following sections. 



4. Homogeneous State Spaces 

To stress the fact that only simple invariance relations are used, it is assumed in 
this section that H is a compact metrizable group. More specifically, for our study, 
the following properties of the state space are used. For the group operation, a 
multiplicative notation is used. 

i) li X, y ^ H and r > then yB{x, r) — B{yx, r) 

ii) There exists a unique Borel measure /i on H, the Haar probability measure, 
invariant by group operations : y ^-^ yx for x € H. 

See Loomis [12] or Weil [25] for an introduction. Simple examples of such a situation 
are: 

(1) For d > 1, the d-dimensional torus 

d 

Td(T) = []M/T,Z, 

i=l 

for T = (T,) e R^. 

(2) For d > 1, the d-dimensional sphere Sd(T), 

Sd{T) = {x^ {xi) eW:xl + --- + x^+i = T^} . 
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In both cases, the normahzed Lebesgue measure on H is the Haar probability 
distribution. Various compact groups of matrices provide additional examples of 
such a situation. Note that a related setting was used by Mecke [T5] to derive a 
key relation between the distribution and the Palm measure of a given stationary 
point processes. 

In the proofs, the local greedy policy is assumed. It is not difficult to see that 
similar arguments can be used for the local one-sided policy. Recall that a strong 
result, Theorem[21 has already been proved for the local random policy. Throughout 
the section the distribution of the locations of points is assumed to be /i which will 
referred to as the uniform measure in the following. From now on and for the rest of 
the paper, (/„) and (X„) are assumed to be independent i.i.d. sequences of random 
variables. 

Lemma 3. The minimal solution N of Equation ^ is a stationary point process 
on H: its distribution is invariant with respect to group operations, i.e. 

f{xy)N{dy) / f{y)N{dy), 

H Jh 

for any x ^ H and any non-negative Borel function f on H . 

Proof. By invariance of /i by translation, property ii) , the random variables Xi and 
xXi have the same distribution. If one denotes TxM the point process M shifted 
by X, i.e. r^M({y}) = M{{x~^y}) for all y G H, then property i) implies that the 
sequence {r^Nn) satisfies Relation ^ with the variable Xi replaced by xXi. One 
concludes that the two sequences (r^Nn) and [Nn) have the same distribution and 
therefore that the same property holds for their limits. The lemma is proved. □ 

Theorem 3. For the LG and LO policies, if p+ < 1/2 and the random variables 
{Xi) are i.i.d. with distribution fi on H , then, almost surely, there exists a unique 
point process N satisfying Relation ([7]) with finite mass, i.e. V{N G A4(H)) =^ 1. 

Proof. By recurrence relation one gets that for any Borel subset of H, 



E 



= P4 



XieA 



{1-P+) F Nn-i{Bix,l)) ^0,ti{x,Nn^i) e A ^iidx), 



where, fj, is the distribution of Xi. This identity with A — H and the monotonicity 
property give in particular that 

(1 ^p+)Jp {N{B{x, 1)) ^ 0) ^i{dx) < p+. 

Since the distribution of N{B(x, 1)) is, by the above lemma, independent of x E H, 
one has 

P (N(B(x, 1)) 7^ 0) < ^+ < 1. 

1 -P+ 

The random variable N(B{x, 1)) has therefore a positive probability of being and, 
in particular, of being finite. The ergodicity property implies that for all x € H, 
N{B{x, 1)) < -fcxo almost surely. The point process N has almost surely a finite 
mass, P(iV e Ai*{H)) — 1 since there is no accumulation point. 
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Let M be a point process satisfying Relation ([7]) and P(A/ e M.{H)) = 1. 
Equation ([7]) gives that 

M{H) o e - M{H) = - l{/i=-,iv(B(Xia))^o}, 

since the right hand side is clearly integrable, the expected value of the left hand 
is 0. See Lemma 12.2 of Robert [21 for example. One gets the relation 

p+ = (l-p+)P(A/(B(Xi,l))^0), 

one obtains the relation 

(8) P(Af(B(Xi,l))=0) = i^^ >0. 

1-P+ 

The minimality property of N , cf. Theorem [1] gives that almost surely iV <C M so 
that 

{M{B{Xi, 1)) = 0} C {N[B(Xi, 1)) = 0}. 

These two subsets having the same probability by Equation Relation ([7]) gives 
therefore that, almost surely, 

{M{H)^N{H)) o e = M{H)~N{H) + l{A=-,Ar(B(Xi4))#o}-l{/i=-,M(B(Xi,i))#o} 
^M{H)~N{H), a.s. 

The non-negative random variable M{H) — N{H) is invariant by 6 and therefore is 
almost surely a constant C by the ergodicity property. Since M{H) < +oo almost 
surely, there exist some m > 1 such that ¥{M{H) = m) > and some finite subset 
{xi, . . . ,Xn} of H such that 

n 

1=1 

On the event {M{H) — m}, it is easily checked that if, for ^ = 1, . . . ,n, a total 
of 2m "— " points are sent in each ball B{xi, 1) and not + occurs, then all the m 
initial points will removed. More precisely, 

n 2m£-l 

{M{H) = m}f] Pi {hoe''^-,Xio9'' eB{xi,l)}c{M{H)oe^'''"^0}. 

1=1 k=2m(i-l) 

Since the variable is J-Q-measurable, it is independent of the sequence of i.i.d. se- 
quence {{Ii,Xi) o 9^,i> 0), one gets therefore that 

< ¥{M{H) o ei^™" = 0) = V{M{H) = 0) = V{M{H) = 0, N{H) = 0), 

one deduces that the constant C = M{H) — N{H) is 0. The two point processes 
M and N coincide. The theorem is proved. □ 

Proposition 2 (Convergence of Distributions of Configurations). For the LG, LR, 

LO policies, if p+ < 1/2 and P is some finite point process on H and (M„) is the 
sequence of point processes defined by, AIq = P and 

Mn = Mn-l + l{I„ =+}Sx„ - = A/„_i(B(X„,l))740}'5ti(X„,M„_i)) 7 n > 1, 

then (Mn) converges in distribution to N, the unique solution of Equation ([7]). 
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Proof. Recall that the sequence (Nn) defined by Equation ([3]) corresponds to the 
case where the mitial state is empty. Let (M„) be the sequence of point processes 
satisfying Relation ([6]) with Mq = P. The sequence (-/V„) defined by Relation (|6]) 
is such that Nq is the empty state. By induction, it is easy to check that, for 
n > 0, Mn — Mn o 6*"" and Nn — Nn o d^"), and therefore that M„ has the same 
distribution as M„. 

The monotonicity property gives that iV„ <ti Mn holds and that if m = P{H) 
is the number of initial points of P then necessarily 

0<MniH)~Nn{H) <m. 

The limit N of (iV„) having a positive probability of being 0, there is almost surely 
an infinite number of £ > such that N{H) o9'^ ^0. The relation lV„(iJ) < N{H) 
implies that there an infinite number oi £ > such that 

Ni,{H) ^Ne{H)oe'^ = 0. 

For these indexes £, Mi{H) < m and, as in the proof of the above theorem, there is 
a positive probability (lower bounded by a quantity independent of the location of 
the points of Mg) that all the M£{H) points are removed before a new "+" arrives. 
Hence, with probability 1, there exists some (random) index £ such that M„ — Nn- 
The convergence in distribution of (A/„) is therefore proved. □ 

Corollary 1. The distribution of N the solution of Equation ^ is the only dis- 
tribution on A4{H) invariant by the equation 

Ml ^ Mq + l[i^=+y5xi - l{/j = _}(5(j(Xi,Mo)- 

Uniqueness Result when H = Ti(T). 

This section is concluded with a uniqueness result for the one-dimensional torus. 
One denotes by >l*(Ti(T)) the subset of elements P of A^*(Ti(r)) with a set 
S{P) of accumulation points negligible for /it, the Lebesgue measure. The follow- 
ing proposition generalizes the uniqueness result of Theorem [3] for the solution of 
Equation ©. 

Proposition 3 (A Uniqueness Property for the Torus). For the LG policy, if M 
is a random variable in A^*(Ti(T)), solution of Equation ([7]), J- q -measurable and 
such that, for any accumulation point a G S{M), 

M{{a, a + e]) = +oo and M{[a — £, a)) ~ +oo 

holds almost surely for any e > sufficiently small, then M is the minimal solution 
N of Equation ([7]) . In particular the set S (M) of accumulation points is empty 

Proof. Assume that such a variable M exists. It is known that S{M) is a deter- 
ministic set and H — S{M) being an open set, it can be written as 

H-SiM) = |J(a„,6„), 

n>l 

where (a„) and {bn) are sequences of elements of S{M). Note that, because of the 
assumption on M near accumulation points, the variable ti{x,M) is well defined 
(i.e. not equal to d) for all x G (a„,&n), n > 1, as long as M{[x — l,a; -|- 1]) ^ 0. 
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The minimality of N implies that N <^ M. From Equation (O, for n > 1 and e 
sufficiently small, 

M([a„ + e, 6„ -e])od- M([a„ + e, 6„ - e]) 

= l{/i=+,Xie[Q„+e,6„-e]} - l{/i = -,A/(S(Xi,l))#0,ti(J>fi,M)e[a„+£,6„-e]}- 

With the same argument as in the previous proof, one gets that the expected value 
of the left hand side of the above identity is and consequently that, 

-^^P{Xi e K + £,&„-£]) 
1-P+ 

= P(Af([Xi + ^0,ti(Xi,iV) e [a„ + £,&„-£]) 

= P(M([Xi + ^0,Xi e (a„,&„),ii(^i,A^) e K + £,6„-£]), 

due to the assumption on accumulation points. By letting e go to one gets the 
relation 

^+ P(Xi e K,6„)) - F{M{[Xi -l,Xi + 1]) ^ 0,Xi e (a„,6„)). 



1-p 

by summing up these terms with respect to n and taking into account the fact that 
fj,{S{M)) = 0, one finally obtains the identity 

P(M([Xi - + 1])) = 0) - 

the same equality also holds for N, but since N ^ M, this implies that, for almost 
every a; G [0,r], 

F{M{[x- + =0) 

= F(N(\x - 1, 2; + 1]) = 0) = P(A^([-1, 1]) = 0) = }—^E± > 0. 

l~p+ 

This is in contradiction with the fact that M has accumulation points at some fixed 
points. The proposition is proved. □ 



5. The case of the Interval [0,T] 

In this section one considers a simple space, the interval [0, T], for which bound- 
ary effects occur contrary to Section [5] where the homogeneity property rules out 
this feature. The LG is analyzed in this case and stability results are proved. It 
should be noted that the LO policy (Local One-Sided), has a completely different 
qualitative behavior, it is analyzed in Section |6] in a more general setting. For the 
LR policy, Theorem [2] addresses this case. 

The value of T is assumed to be greater than 1, otherwise the stability problem 
is trivial. The location of the points is an i.i.d. sequence (Xi) of uniform random 
variables on [0, T]. The variable N is the minimal solution of Equation ([7]). As be- 
fore, the ergodicity property and Theorem [T] give that the set S{N) of accumulation 
points of N is deterministic. 

Properties of possible accumulation points of N are now analyzed in four steps. 
The set S{N) is assumed to be non-empty. 

(a) Accumulation points are at distance at least 1. 

Assume that there is at least two elements a < 6 in S{N) such that b ~ a < 1 and 



THE EVOLUTION OF A SPATIAL STOCHASTIC NETWORK 



17 



(a, 6) C H—S{N). Take some e sufficiently small, Equation ([6]) for the sequence 
{Nn) gives the relation 

E (F„+i([a -e,b + e])oe) - E (iV„([a -e,b + e])) 

= p+(5-a + 2e)-P(lV„(B(Xi,l)) ^0,t(Xi,iV„) e [a~s,b + s]), 

and by the monotonicity property of (Nn), 

P(7V„(B(Xi,l)) ^0,Xi G [a + £,6-£],<(Xi,iV„) e [a-e,b + e]) 

< -^^{b-a + 2e). 

1 -P+ 

Since a and 6 are almost surely accumulation points, the non-decreasing sequence 
of sets 

{NniBiXi,l))^0,Xi e [a + e,b-e],t{Xi,Nn) £ [a~e,b + e]} 

converges, as n goes to infinity, to the set {a + e < Xi < b — e}. By taking the 
limit in the last inequality, one gets the relation 

b-a-2e < , (b - a + 2e), 
1 -P+ 

by letting e go to 0, this gives p+ > 1/2. Contradiction. Consequently, if there are 
accumulation points for N, they are isolated points of [0,T] at distance 1 at least. 

(b) Coupling. 

One denotes temporarily by Nx the point process, solution of Equation ([7]), asso- 

ciated to uniform random variables on [0, T]. Let S <T and (iV„) be the sequence 
defined by 

^n+l ° ^ + l{/i=+l,Xi<S}^Xi - l{/i = -l,lV„(B(Xi,l))#0,Xi<S}^ti(Xi,lvf)- 

then, almost surely, 

lim W^^^^- Ms^'^'- Ns. 

n— >-t-oo 

g 

By induction, it is easily checked that A^„([0, "S] n •) <C iV„ holds for all n > 1. The 
inequality <^ instead of equality comes from the fact that for Nn{[0, S]r\-) a minus 
arriving in [S,T] can kill a point in [0,5]. By letting n go to infinity, one obtains 
the relation 

(9) 7V([0,5]n-) <Ms. 

(c) Patterns of Accumulation Points. 

Denote by S+{N) the subset of elements of S{N) which have an infinite number of 
points of N on their right, 

S+{N) ^{xe [0,T] : 3eo > 0,Ve < eo,N{{x,x + ej) = +oo a.s. }. 

Similarly S-{N) is defined for left neighborhoods. 

Claim: There do not exist a e ^^-(A^) and b e S^{N) such that (a, 6) C [0,r] - 
S{N). Assume there are such a and b. Equation ([7]) for N gives the relation 

Noe~ N 

= 'i{Ii=+,a<Xi<b}Sxi - '^{h = -,N{[Xi~l,Xi + l])^0,a<ti{Xi.N)<b}Sti{Xi,N), 
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valid in the space M{[a,b]). Because of the assumption on a and b and of the 
definition of ti{-, N), one has the identity 

{Ni[Xi - 1, Xi + 1]) ^ 0, a<h{Xi,N)<b}={N{[Xi - 1, + 1]) ^ 0, a<Xi<b} 
which gives the relation 

(10) iVoe'-iV 

= ^{h=+,a<Xi<b}Sxi - '^{Ii = -,N{[Xi-l,Xi + l])^0,a<Xi<b}Sti{Xi,N)- 

If a and b are identified, the above equality states that the point process N restricted 
to the torus Ti(6— a) = [a, b] satisfies Relation ^ for this state space. Proposition[3] 
shows that N on [a, b] is a point process with finite mass. Contradiction. 

(d) Conclusion. 

Recall that N is the limit of the {Nn) when the sequence {Xi) is i.i.d. uniformly 
distributed on [0,T]. Since (Xi) has the same distribution as (T — Xi), one deduces 
that the distribution of N is invariant with respect to the mapping x i— t- T — x. 
Accumulation points of N being at distance 1 at least by (a), S{N) is a finite set, 
S{N) = {oi, . . . , Op}, for some p+ > 1 and < oi < 02 < • • • < Cp < T. 

Assume that ai g S+{N) holds. By symmetry of N with respect to the mapping 
X — > T — X, one gets that ap = T — ai G S-{N). By (c) one has necessarily 
02 e S+{N), and therefore ap_i e S-{N). By proceeding inductively, one deduces 
that there exists a. k < p such that ak e S+{N) and ak+i £ S^{N). This is 
impossible according to (c). 

Consequently, oi G S-{N) and oi > 0. By the coupling result ^ above, with 
the same notations as in (b), one has 

iVT([0,ai]n-) «7Va,. 

In particular ai is an accumulation point of Na-^ , by symmetry of Na-^ with respect 
to the mapping x ai — x, one gets that is also an accumulation point of Na-^ . 
Consequently, S'(iVaJ = with bi £ S+{Nai) which is impossible by 

what have just been proved. The set (N) is therefore empty. 

The uniqueness statement of the following proposition has therefore been proved. 

Proposition 4 (Stability property for the LG policy). 

If p+ < 1/2 and the random variable Xi is uniformly distributed on [0,T], then 
Equation ([7]) has a unique minimal solution N such that P(iV G M{H)) = 1. 

//iVg is an element of M{[0,T]) with finite mass, then the sequence (Nn) defined 
by Recursion ([3]) converges in distribution to N . 

Proof. The proof of the convergence in distribution follows the same lines as in the 
proof of Proposition [2j □ 

The distribution of the variable Xi is now assumed to have a density h with respect 
to Lebesgue's Measure. 

Proposition 5 (Non- Uniform Distributions). If p+ < 1/2 and the distribution 
of Xi has density h on [0, 1] which is piecewise constant on a finite partition of 
sub-intervals of [0,T], then the conclusions of Proposition^ also hold in this case. 

Proof. The proof is sketched since most of the arguments have been already used 
at several occasions. By assumption there is a partition of [0, T] by sub-intervals 
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{Ik,k e K) and {ak,k G K) such that, for x G [0, T], 

The sequence (iV„) defined by Recurrence ^ can be dominated by the sequence 
of point process (Nn) whose dynamic is modified as follows: a minus point falling 
into some sub-interval n does not kill a point in another sub-interval. In this 
way, for n > 1, one has clearly iV„ ^ Nn- Now, for k ^ K, the point process 
Nn restricted to Ik is, up to a translation, simply the point process associated to 
uniformly distributed random variables on Ik when 

l{Xie/fc} + l{X2e/fc} H ^ '^{x^eh} 

points have been used. By Proposition |4l the point processes Nn, n > 1 are upper 
bounded by a point process with finite mass. This shows that N, the limit of (Nn), 
has almost surely a finite mass. □ 

6. One-Sided Policies 

In this section, a multi-dimensional generalization of the results of Robert [5U] 
is presented. It is assumed that T = {Ti) e R'l with Tj > for 1 < ? < d, /J is 
defined as 

d 

H = Y[[0,T,], 

1=1 

and that the locations of the points (Xi) are uniformly distributed in H. 

With a slight abuse of notation, one will denote H — [0,T]'^ and ii x, y ^ M.+ , 
xy [resp. x/y] will stand for [xiyi) [resp. {xi/yi)]. Similarly, if a; = [xi) e K."^, logx 
denotes (logXi) and finally A is the subset defined as the lower boundary of iJ, 

A {x e [0, Tf : 3i e {1, . . . , d}, X, = 0}. 

A "— " particle at x can only kill the closest particle of the point process in the 
orthant with the corner at x, i.e. in the set {x + M.'^) n H. In order to get a more 
precise characterization of the variable N of Theorem [U the following notation has 
to be introduced. If M G M*{II), one denotes by D{M) the "dead zone" of M 
for minus particles, i.e. the set of locations where no point of M can be killed by 
them, 

D(M) ^{y(EH:M{{y + E.^) D H) = 0}. 
If M is the nuU measure, then D{M) — H and if P, Q G M*[II) are such that 
P « Q, then D{Q) C D{P). 

In this context, the corresponding stationary evolution equation is given by 

(11) iV o 6* = iV + - l{/i=-,Js:i0_D(Ar)}<5ti(Xi,Ar)- 

With the same arguments as in Theorem [T] for local policies, there exists a unique 
minimal N in the set M.*{H) with probability 1 which is solution of Equation (ITlT) . 
The variable N is the limit of the non-decreasing sequence {Nn) defined by the 
recurrence 

(12) 7V„+i o0 = iV„ + l{/i=+i}<5xi - l{j^^_i_Xi^D(lv„)}'5ti(Xi,lv„)- 

The following proposition establishes a specific property of this policy, namely that 
it exhibits an invariance with respect to scaling. 
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Proposition 6. If p+ < 1/2 and a ^ {ai) <E M.'l with < at < 1 for 1 < i < d, 

for the GO policy the minimal solution N of Equation (jlip satisfies the invariance 
relation 

(13) / f{x)N{dx) / f{ax)N{dx) 

J[0,qT]<* J[(),TY 

for any continuous function on [0,T]'^. Furthermore N is almost surely a Radon 
measure on [0,r]'^ — A. 

Proof. Relation (fT3|) is a consequence of the two following simple facts: 

— The variables {Xi) that are in [0, aT] have the same distribution as {aXi). 

— Invariance by scaling of the dynamics: 

/ f{x)N,Adx)''= [ f{ax)Nn{dx), 

JlO,aT]'' J[G,TY 

where Vn is the first index k for which exactly n elements of the k first 
points are in [Q^oTY. Relation (|13p follows from this identity by letting n 
go to infinity. 

Equation (fT2|) gives the inequality 

0<E(]V„(i/)) - E(]V„_i(i/)) = p-{l-p)¥{X^(^D{Nn-i)). 

By letting n go to infinity and by using the fact that the non-increasing sequence 
of sets {D{N n-i)) is converging to D{N), one gets therefore that 

V{Xi ^ D{N)) < < 1. 

1 -p+ 

The set D{N) is therefore non-empty with some positive probability. 

With the ergodicity property, any accumulation point a = (a^) G [OjT]'* of 
N is deterministic. Assume that > for all 1 < i < d. One considers the 
case where all the are such that < T^, the others situations are treated in 
a similar way by using one-sided neighborhoods of a. Take Sq > sufficiently 
small so that, if e < eo, then a + e (a^ + e) and a — e e [0, T]''. One denotes 
by (tti) = {T/{ai + e)), then with probability 1, N{[a ~ e,a + e]'') = -l-oo for all 
< e < £o- Relation ([T3l) implies therefore that T is also an accumulation point. 
This contradicts that the fact that the set D{N) is therefore non-empty with some 
positive probability. One concludes that if there exists an accumulation point of A'^, 
then necessarily one of its coordinates is null and therefore it belongs to A. This 
shows P(iVe A^([0,T]''-- A)) = 1. 

□ 

The following proposition shows that for the invariant distribution, configura- 
tions under the GO policy have an infinite number of points with probability 1. It 
will be shown that this property also holds for the local version of the policy. 

Proposition 7 (Infinite number of points near A). Almost surely, any point of 
the set A is an accumulation point of the solution N of Equation (llip for the GO 
policy. Furthermore, the point process N on R^J. defined by 

[ <5_iog(„/T)A^(rf")- 

J[0,T]'' 
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is a stationary point process on M.'^, i.e. for x G M^J., the distribution of the variable 
N is invariant with respect to the translation to x: 

fix + y)N{dy)''^'- I f{y)N{dy), 



for any continuous function f with compact support on R'|_ . 

Proof. Let a G A, it is assumed, that for example, only the first coordinate is 0, 
a = (0, 02, ... , Od). Let 0<(5<1, e>0 and denote by 

d 

As = [0,(5ri] X ]J[a„a, +£], 

i=2 

by taking a = (5, 1, . . . , 1) and using Relation p^ . one gets the identity 

for all < (5 < 1. Since 9{N{As) < +oo) is either or 1 and since clearly 
¥{N{Ai - As) ^ 0) > 0, one gets that F{N{As) = +oo) = 1. By the above 
proposition, one has that N{Ai — As) is almost surely finite. One concludes that 
a is an accumulation point. Consequently, the same property holds when there are 
several coordinates which are 0. 

Relation ([T5)) gives that, for a G [0, 1]'*, the identity 

(^^ "'^»]^ ,x,y e [0, Tf, y <x^ 

dist. 



N [l[[y,,xn ,x,y e [0,Tf,y < X 



\ \i=l / 

holds. By taking z — — log a, this relation can be rewritten as 



N ^IIK + z^,Ui + z^]j 



u,v eM.'l,v < u 



dist. 



The point process N is invariant with respect to the non-negative translations. 

□ 

Corollary 2 (Local One-Sided Policy on the torus Ti(T)). 
The minimal solution of the equation 

NloO = Nl + 1{/i=+}(5xi - '^{h = -,Xi<^D(NL)M{XuNL)<=iB{Xul)}^ti{XuNL)- 

for the LO policy is such that ¥(Nl G A4((0,T])) = 1 and every element of A is 
almost surely an accumulation point of N. 

Proof. With the same arguments as before, it is not difficult to prove that the 
solution N of Equation ((TT|) . is such that N <C Nl which gives the result for 
the accumulation points. The proof that Nl is a Radon measure on (0, T) with 
probability 1 is sketched. As before, one first proves that accumulation points are at 
distance 1 at least. If there is another accumulation point than 0, denote by a > 
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the smallest which is not 0, by considering the evolution of the number of points 
on the interval [a — 1, a + e] for some e > 0, it is not difficult to get a contradiction 
to the fact that p+ < 1/2. □ 
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